How to stop numpy from iterating over custom Mapping objects